SYSTEM AND METHOD FOR EFFICIENTLY VISUALIZING 
AND COMPARING COMMUNICATION NETWORK SYSTEM 

PERFORMANCE 


CROSS-REFERENCE TO RELATED APPLICATIONS 

This application is related to the co-pending U.S. Patent 
Application Serial Nos. 09/352,679 filed July 14, 1999; 09/318,840 filed 
May 26, 1999; 09/318,841 filed May 26, 1999; 09/221,985 filed December 
29, 1998, and 09/318,842 filed May 26, 1999; and is also related to the 

concurrently filed applications having U.S. Serial Nos. 09/ , , entitled 

"Method and System for Designing and Deploying a Communications 

Network which Considers Frequency Dependent Effects"; and 09/ , , 

entitled "Method and System for Designing a Communications Network 

which Considers Component Attributes" and 09/ , , entitled "Method 

and System for Designing a Communications Network which Allows the 
Simultaneous Selection of Multiple Components", all of which are 
assigned to a common assignee, and the subject matter of these 
applications is incorporated herein by reference. 

DESCRIPTION 

BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention generally relates to engineering and 
management systems for the design of wireless and wired communication 
systems and, more particularly, to a method for comparing the performance 
of wireless and wired systems in any environment (e.g., buildings, floors 
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within a building, campuses, within cities, an outdoor setting, etc.) using a 
three-dimensional (3-D) visualization method. 

Description of the Prior Art 

As communication systems proliferate, radio frequency (RF) 
5 coverage within and around buildings, and radio signal penetration into 

and out of buildings, has become a critical design issue for 
communications engineers who must design and deploy cellular telephone 
systems, paging systems, or new wireless technologies such as personal 
communication systems (PCS), wireless local area networks (WLAN), and 

10 local multi-point distribution systems (LMDS). Emerging hand-held 

appliances will increasingly use wireless access methods, necessitating the 
need for tools and methods that allow technicians and engineers to rapidly 
install such wireless infrastructure. Also, the fiber optic and baseband 
networks needed to carry internet traffic will proliferate rapidly in the 

1 5 future, as well. In addition, RF networks involving micromachinery, RF 

identification tags, and optical communication links are of increasing 
interest due to the rapid miniaturization of communication devices and 
sensors, and the rapid proliferation of fiber optic bandwidth in and around 
campuses. Designers are frequently requested to determine if a radio 

20 transceiver location or base station cell site can provide adequate, reliable 

service throughout a room, a building, an entire city, a campus, a shopping 
mall, or any other environment. The costs of in-building and microcellular 
wireless communication devices are diminishing while the workload for 
wireless system design engineers and technicians to deploy such systems is 

25 increasing sharply. Given these factors, rapid engineering design and 

deployment methods accompanied by comprehensive system performance 
visualization and analysis methods are vital to wireless communication 
system designers. 
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In addition, recent research efforts by AT&T Laboratories, 
Brooklyn Polytechnic, and Virginia Tech are described in papers and 
technical reports entitled: S. Kim, B. J. Guarino, Jr., T. M. Willis III, V. 
Erceg, S. J. Fortune, R. A. Valenzuela, L. W. Thomas, J. Ling, and J. D. 
5 Moore, "Radio Propagation Measurements and Predictions Using Three- 

dimensional Ray Tracing in Urban Environments at 908 MHZ and 1 .9 
GHz," IEEE Transactions on Vehicular Technology, vol. 48, no. 3, May 
1999 (hereinafter "Radio Propagation"); L. Piazzi, H. L. Bertoni, 
"Achievable Accuracy of Site-Specific Path-Loss Predictions in 

10 Residential Environments," IEEE Transactions on Vehicular Technology, 
vol. 48, no. 3, May 1999 (hereinafter "Site-Specific"); G. Durgin, T. S. 
Rappaport, H. Xu, "Measurements and Models for Radio Path Loss and 
Penetration Loss In and Around Homes and Trees at 5.85 GHz," IEEE 
Transactions on Communications, vol. 46, no. 11, November 1998; 

15 T. S. Rappaport, M. P. Koushik, J. C. Liberti, C. Pendyala, and T. P. 

Subramanian, "Radio Propagation Prediction Techniques and Computer- 
Aided Channel Modeling for Embedded Wireless Microsystems," ARPA 
Annual Report, MPRG Technical Report MPRG-TR-94-12, Virginia Tech, 
July 1994; T. S. Rappaport, M. P. Koushik, C. Carter, and M. Ahmed, 

20 "Radio Propagation Prediction Techniques and Computer-Aided Channel 

Modeling for Embedded Wireless Microsystems," MPRG Technical 
Report MPRG-TR-95-08, Virginia Tech, July 1994; T. S. Rappaport, M. P. 
Koushik, M. Ahmed, C. Carter, B. Newhall, and N. Zhang, "Use of 
Topographic Maps with Building Information to Determine Antenna 

25 Placements and GPS Satellite Coverage for Radio Detection and Tracking 

in Urban Environments," MPRG Technical Report MPRG-TR-95-14, 
Virginia Tech, September 1995; T. S. Rappaport, M. P. Koushik, M. 
Ahmed, C. Carter, B. Newhall, R. Skidmore, and N. Zhang, "Use of 
Topographic Maps with Building Information to Determine Antenna 

30 Placement for Radio Detection and Tracking in Urban Environments," 


3 


256036AA 


MPRG Technical Report MPRG-TR-95-19, Virginia Tech, November 
1995; and S. Sandhu, M. P. Koushik, and T. S. Rappaport, "Predicted Path 
Loss for Rosslyn, VA, Second set of predictions for ORD Project on Site 
Specific Propagation Prediction," MPRG Technical Report MPRG-TR-95- 
5 03 , Virginia Tech, March 1 995 . 

The papers and technical reports are illustrative of the state-of-the- 
art in site-specific radio wave propagation modeling. While most of the 
above papers describe a comparison of measured versus predicted RF 
signal coverage and present tabular or two dimensional (2-D) methods for 

1 0 representing and displaying predicted data, they do not report a 

comprehensive method for visualizing and analyzing wireless system 
performance. The "Radio Propagation" and "Site-Specific" papers make 
reference to 3-D modeling, but do not offer novel display methods or 
graphical techniques to enable a user to visualize signal coverage or 

1 5 interference in 3-D. Furthermore, there do not exist effective methods that 

allow a wireless communications technician or designer to rapidly display 
predicted performance values, or to compare, through visualization, 
differences in predicted performance values between alternate network 
design concepts within a particular specified environment. 

20 Common to all wireless communication system designs as well as 

wired network designs is the desire to maximize the performance and 
reliability of the system while minimizing the deployment costs. Ways to 
minimize cost include the use of computer aided design tools that manage 
many aspects of the design process. Such tools also help create methods 

25 that enable the engineer or technician to work quickly. Consider a wireless 

system, for example. Analyzing radio signal coverage and interference is 
of critical importance for a number of reasons. A design engineer must 
determine if an environment that is a candidate for a wireless system 
contains too much noise or interference, or if the existing wireless system 

30 will provide sufficient signal power throughout the desired service area. 
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Alternatively, wireless engineers must determine whether local area 
coverage will be adequately supplemented by existing large scale outdoor 
wireless systems, or macrocells, or whether indoor wireless transceivers, or 
picocells, must be added. The placement of these cells is critical from both 
5 a cost and performance standpoint. The design engineer must predict how 

much interference can be expected from other wireless systems and where 
it will manifest itself within the environment. Prediction methods which 
are known to the inventors and which are available in the literature provide 
well accepted methods for computing coverage or interference values for 

10 many cases. However, the implementation of such models are generally 
very crude, and rely on cumbersome spreadsheets, or inefficient operating 
platforms in research laboratories with little support and little visualization 
capability. Inevitably, performance measurements must be made in the 
environment of interest in order to generate the proper prediction models, 

15 or to at least verify the chosen prediction models for acceptable accuracy or 

reliability. 

Depending upon the design goals, the performance of a wireless 
communication system may involve a combination of one or more factors. 
For example, the total area covered in adequate received signal strength 

20 (RSSI), the area covered in adequate data throughput levels, and the 

number of customers that can be serviced by the system are among the 
deciding factors used by design engineers in planning the placement of 
communication equipment comprising the wireless system. Thus, 
maximizing the performance of a wireless system may involve the 

25 complex analysis of multiple, potentially unrelated factors. The ability to 

display the results of such analysis in a mariner easily interpretable by 
design engineers is invaluable in wireless system deployment. Three 
dimensional (3-D) visualization of wireless system operating parameters 
provides the user with rapid assimilation of large data sets and their 

30 relation to the physical environment. As wireless systems proliferate, these 
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issues must be resolved quickly, easily, and inexpensively, in a systematic 
and repeatable manner. 

There are many computer aided design (CAD) products on the 
market that can be used to design a computerized model of an 
5 environment. WiSE™ from Lucent Technology, Inc., SignalPro™ from 

EDX, PLAnet™ by Mobile Systems International, Inc., (later known as 
Metapath Software International, now part of Marconi, P.L.C.) and TEMS 
from Ericsson , Wizard by Safco Technologies, Inc. (now part of Agilent 
Technologies, Inc.), are examples of CAD products developed to aid in the 

10 design of wireless communication systems. 

Lucent Technology, Inc., offers WiSE™ as a design tool for 
wireless communication systems. The WiSE system predicts the 
performance of wireless communication systems based on a computer 
model of a given environment using a deterministic radio coverage 

1 5 predictive technique known as ray tracing. 

EDX offers SignalPro® as a design tool for wireless 
communication systems. The SignalPro system predicts the performance 
of wireless communication systems based on a computer model of a given 
environment using a deterministic RF power predictive technique known 

20 as ray tracing. 

Mobile Systems International, Inc., (now a part of Marconi, 
P.L.C), offers PLAnet™ as a design tool for wireless communication 
systems. The PLAnet system predicts the performance of macrocellular 
wireless communication systems based upon a computer model of a given 

25 environment using statistical and empirical predictive techniques. 

Ericsson Radio Quality Information Systems offers TEMS™ as a design 
and verification tool for wireless communication indoor coverage. The 
TEMS system predicts the performance of indoor wireless communication 
systems based on a building map with input base transceiver locations and 

30 using empirical radio coverage models. 
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The above-mentioned design tools have aided wireless system designers by 
providing facilities for predicting the performance of wireless 
communication systems and displaying the results in the form of flat, two- 
dimensional grids of color or flat, two-dimensional contour regions. Such 
5 displays, although useful, are limited by their two-dimensional nature in 

conveying all nuances of the wireless system performance. For example, 
slight variations in color present in a two-dimensional grid of color, which 
may represent changes in wireless system performance that need to be 
accounted for, may be easily overlooked. Furthermore, as wireless systems 

10 proliferate, the ability to visually predict and design for coverage and 

interference is of increasing value. 

Common to all communication system designs, regardless of 
technology, size or scale, is the need for measurement data at some point in 
the design process. For environments which are candidates for wireless 

1 5 communication systems, it is essential to first conduct a measurement 

campaign to determine spectral occupancy, noise levels, interference 
levels, or available channels. 

Whether in the initial design stage or the final verification stage, or 
during ongoing maintenance during the lifecycle of a communication 

20 system, no communication system is implemented without the input and 

use of measurement data. However, measurement acquisition within 
in-building environments is much more tedious and time consuming than 
in the macrocellular environment where measurement acquisition is carried 
out using Global Positioning System data to determine the location of the 

25 measurement being taken. Global Positioning System (GPS) data, which 

so many RF engineers have come to rely upon for outdoor measurement 
acquisition, is not an option for microcell environments in most cases, and 
is extremely difficult to use reliably within buildings, due to the clutter and 
resulting attenuation of the GPS satellite signal levels within urban areas 

30 and within manmade structures. While new methods, such as the 
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Qualcomm SnapTrack indoor GPS system may offer long-term promise 
for in-building location, today's readily available GPS solutions are 
expensive and are seldom available to engineers or technicians tasked with 
the deployment, measurement, or optimization of in-building or microcell 
5 networks. Therefore, recording real-time measurement data within a 

building becomes a laborious, time-consuming task involving scratched 
notes and blueprints and manual data entry which are both expensive and 
ineffectual in many respects. 

In addition to measuring RF signal properties from emitted base 

1 0 transceivers there is also a need to measure data throughput time in 

computer data networks. Throughput time is the time required to transfer a 
record or file of known size from one computer to another. In order to 
standardize the measurement of data throughput time for comparison or 
verification purposes, files of a set size (e.g., 100K) are used and 

1 5 transferred in packet sizes such as 5 1 2 bytes. Similar to RF signal 

attenuation, data throughput time, and each of a many number of other 
important network measurement parameters, such as packet latency, bit 
error rate, packet error rate, and bit rate throughput, is also a function of 
transmission distance and signal obstruction (e.g. walls, doors, partitions), 

20 as well as multipath propagation and the specific radio modem design. 

Presently, there are no known effective visualization techniques 
that allow an engineer or wireless technician to display measurement 
results or rapidly compare, through visualization, various measurement 
results of various performance measurements of a particular 

25 communication network, or collection of networks, within a particular 

specified environment over time, frequency, or space. Various signal 
property measurement acquisition tools and systems have been developed 
to aid in the design of wireless communication systems such as PenCat™, 
Walkabout PCS™ and TEMS Light. 

30 LCC International Inc. offers the PenCat™ as a pen-based 
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collection and analysis tool for wireless communication design that runs on 
a small hand-held tablet computer. The PenCat™ system enables a user to 
roam about a building, take signal property measurement data at a location 
in the building using a receiver linked to the tablet computer, and link the 
5 measured data to that building location on a computer map representing the 
building by tapping the appropriate portion of the map on the computer 
screen with a stylus pen. The building map can be entered into the 
PenCat™ system by either scanning blueprints, sketching the building 
within the application, or importing from another source. PenCAT uses 

10 two dimensional bit maps to model the building environment. 

Safco Technologies, Inc. (now part of Agilent Technologies, Inc.) offers 
the Walkabout PCS™ system as a portable survey coverage system for use 
in indoor or outdoor wireless communication system design. Similar to 
PenCat™, the Walkabout PCS™ system utilizes a hand-held computer 

1 5 linked to a receiver for measuring signal properties at a given location and 

linking the measured property data to that location represented on a stored 
computer map. Also similar to the Safco Walkabout is the Agilent 74XX 
indoor measurement system, which also uses a bitmap floor plan. 
Ericsson Radio Quality Information Systems offers the TEMS Light 

20 system as a verification tool for wireless communication indoor coverage. 

The TEMS Light system utilizes a Windows-based graphical interface with 
two dimensional bit map drawings on a mobile computer linked to a 
receiver to allow a user to view a stored building map, make location 
specific data measurements, and link the measured data to the represented 

25 location on the stored computer map. Unlike other in-building 

communication measurement systems, InFielder™ by Wireless Valley 
Communications, Inc. merges measurement data with periodic updates of 
position location on a three-dimensional model of the physical 
environment. The InFielder™ product concept is disclosed in U.S. Patent 

30 Application Serial No. 09/22 1 ,985 filed December 29, 1 998, and the 
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contents of this application are herein incorporated by reference. However, 
as originally disclosed in the aforementioned patent application, InFielder, 
does not offer an efficient method for rapidly viewing and comparing 
measurement data in a 3-D environment such that measurement values, 
5 and comparisons of measurement values, may be quickly determined and 

inferred by the user. 

SUMMARY OF THE INVENTION 

It is therefore an object of the present invention to facilitate the 
display of predicted performance results and the display of comparisons 
1 0 between predicted performance results for wireless or wired 
communication systems. 

It is another object of the present invention to provide a mechanism 
for displaying predicted performance results and displaying the 
comparisons between predicted performance results for wireless or wired 
1 5 communication systems. 

It is another object of the present invention to facilitate the three- 
dimensional, multi-colored display of predicted performance results and 
comparisons between predicted performance results for any type of 
wireless or wired communication system. 
20 It is another object of the present invention to provide a mechanism 

for viewing a three-dimensional display of predicted performance results 
and comparisons between predicted performance results from any angle, 
orientation, distance, or perspective. 

It is another object of the present invention to provide a mechanism 
25 for viewing a three-dimensional display of predicted performance results 

and comparisons between predicted performance results and interacting 
with the display in real-time to alter the current viewpoint and perspective. 

It is another object of the present invention to provide said display 


10 


256036AA 


of predicted performance results and comparisons between predicted 
performance results overlaid on a three-dimensional database that may 
involve a plurality of building structures and the surrounding terrain, flora, 
climatic conditions, and additional static and dynamic obstacles (e.g., 
5 automobiles, people, filing cabinets, etc.). 

It is another object of the present invention to provide a mechanism 
for coloring, shading, and otherwise rendering a solid representation of 
said three-dimensional display utilizing multiple colors and transparency 
effects. 

1 0 In addition to the above, it is yet another object of the present 

invention to facilitate the display of measurements and the display of 
comparisons between measured performance results for wireless or wired 
communication systems. 

It is another object of the present invention to provide a mechanism 

1 5 for displaying measurements and displaying the comparisons between 

measured performance results for wireless or wired communication 
systems. 

It is another object of the present invention to facilitate the three- 
dimensional, multi-colored display of measurements as well as 
20 comparisons between measured performance results for any type of 
wireless or wired communication system. 

It is another object of the present invention to provide a mechanism 
for viewing a three-dimensional display of measurements as well as 
comparisons between measured performance results from any angle, 
25 orientation, distance, or perspective. 

It is another object of the present invention to provide a mechanism 
for viewing a three-dimensional display of measurements as well as 
comparisons between measured performance results and interacting with 
the display in real-time to alter the current viewpoint and perspective. 
30 It is another object of the present invention to provide said display 
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of measurement performance results as well as said display of comparisons 
between measured performance results overlaid on a three-dimensional 
database that may involve a plurality of building structures and the 
surrounding terrain, flora, climatic conditions, and additional static and 
5 dynamic obstacles (e.g., automobiles, people, filing cabinets, etc.). 

It is another object of the present invention to provide a mechanism 
for coloring, shading, and otherwise rendering a solid representation of 
said three-dimensional display utilizing multiple colors and transparency 
effects. 

1 0 In addition to the above, it is yet another object of the present 

invention to facilitate the comparisons between predicted and measured 
performance results for wireless or wired communication systems. 

It is another object of the present invention to provide a mechanism 
for displaying the comparisons between predicted and measured 

1 5 performance results for wireless or wired communication systems. 

It is another object of the present invention to facilitate the three- 
dimensional, multi-colored display of comparisons between predicted and 
measured performance results for any type of wireless or wired 
communication system. 

20 It is another object of the present invention to provide a mechanism 

for viewing a three-dimensional display of comparisons between predicted 
and measured performance results from any angle, orientation, distance, or 
perspective. 

It is another object of the present invention to provide a mechanism 
25 for viewing a three-dimensional display of comparisons between predicted 

and measured performance results and interacting with the display in real- 
time to alter the current viewpoint and perspective. 

It is another object of the present invention to provide said display 
of comparisons between predicted and measured performance results 
30 overlaid on a three-dimensional database that may involve a plurality of 
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building structures and the surrounding terrain, flora, climatic conditions, 
and additional static and dynamic obstacles (e.g., automobiles, people, 
filing cabinets, etc.). 

It is another object of the present invention to provide a mechanism 
5 for coloring, shading, and otherwise rendering a solid representation of 
said three-dimensional display utilizing multiple colors and transparency 
effects. 

According to the present invention, a system is provided for 
allowing a RF system designer or a communication network designer to 

10 dynamically model a wired or wireless system electronically in any 

environment. The method includes the selection and placement of models 
of various wireless or optical or baseband communication system hardware 
components, such as antennas (point, omnidirectional, directional, leaky 
feeder, distributed, etc.), base stations, base station controllers, 

15 transceivers, amplifiers, cables, splitters, attenuators, repeaters, wireless 
access points, couplers, connectors, connection boxes, splicers, switches, 
routers, hubs, transducers, translators (such as devices which convert 
between RF and optical frequencies, or which convert between RF and 
baseband frequencies, or which convert between baseband and optical 

20 frequencies, and devices which translate energy from one part of the 

electromagnetic spectrum to another), power cables, twisted pair cables, 
optical fiber cables, and the like, and allows the user to visualize, in three- 
dimensions, the effects of their placement and movement on overall system 
performance throughout the modeled environment. Thus, the placement of 

25 components can be refined and fine-tuned prior to actual implementation 

of a system or network , wherein performance prediction modeling or 
measurement may be used for design and deployment; and to ensure that 
all required regions of the desired service area are blanketed with adequate 
connectivity, RF coverage, data throughput, or possess other required 

30 network system performance values, such as acceptable levels of quality of 
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service (QoS), packet error rate, packet throughput, packet latency, bit 
error rate, signal-to-noise ratio (SNR), carrier-to-noise ratio (CNR), signal 
strength or RSSI, rms delay spread, distortion, and other commonly used 
communication network performance metrics, known now or in the future, 
which may be measured or predicted and which may be useful for aiding 
an engineer in the proper installation, design, or maintenance of a wired or 
wireless communications network. In the case of an optical or baseband 
wired network, for example, the placement and performance of 
components can be visualized within the invention to ensure that proper 
portions of the environment are supplied with service, so that users within 
the environment may connect directly (with a hardwired connection) or via 
a wireless or infrared connection which can be provided throughout the 
wired network using translators, converters, wireless access points, and 
other communication components that facilitate frequency translation and 
wireless access from the wired network. The three-dimensional 
visualization of system performance provides RF and network system 
designers with tremendous insight into the functioning of the modeled 
wireless or wired communication system, and represents a marked 
improvement over previous visualization techniques. 

To accomplish the above, a 3-D model of the physical environment 
is stored as a CAD model in an electronic database. The physical, 
electrical, and aesthetic parameters attributed to the various parts of the 
environment such as walls, floors, foliage, buildings, hills, and other 
obstacles that affect radio waves or which impede or dictate the routing of 
wiring paths and other wired components are also stored in the database. 
A representation of the 3-D environment is displayed on a computer screen 
for the designer to view. The designer may view the entire environment in 
simulated 3-D, zoom in on a particular area of interest, or dynamically alter 
the viewing location and perspective to create a "fly-through" effect. 
Using a mouse or other input positioning device the designer may select 
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and view various communication hardware device models that represent 
actual communication system components from a series of pull-down 
menus. A variety of amplifiers, cables, connectors, and other hardware 
devices described above which make up any wired or wireless 
5 communication system or network may be selected, positioned, and 

interconnected in a similar fashion by the designer to form representations 
of complete wireless or wired communication systems. 

In the present invention, the designer may run performance 
prediction calculations, measure actual performance characteristics within 

10 an environment, or gather performance data using some other method 

known now or in the future. A point of novelty of the current method and 
apparatus is for displaying the results of measurements, comparisons of 
measurements, and comparisons of predicted performance results using a 
3-D visualization method that is well suited for use within the 3-D model 

1 5 of the physical environment such that an engineer or technician can rapidly 

determine the meaning or importance of the measurement or comparison 
of measurements or comparison of performance results while viewing the 
display within the electronic model of the environment which shows the 
approximate or exact location from where each measurement or the 

20 comparison of measurements or comparison of performance results were 

collected or computed. 

The method presented additionally provides a means for visualizing 
a 3-D iconic view of predicted performance values. Using a cylindrical or 
other shape object with varying height and color, the present invention 

25 allows for rapid visualization of complex performance data at a select 

number of points in the environment termed "watch points". The present 
invention extends the prior art in this area by allowing a designer a quick, 
3-D view of performance data overlaying the environment model. 

The present invention additionally creates a new method and 

30 system for providing a way to conveniently visualize individual 
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measurement watch points for rapid inference of meaning, as well as 
conveniently visualizing and rapidly inferring the meaning of differences 
between measurement runs collected within the same 3-D environment, 
using the same or different communication network designs. A 
5 measurement run is a series of measurements, usually performed by a 

technician or engineer within an environment (such as a city, a town, a 
campus, a group of buildings, or a building of interest), although such 
measurements may be carried out by non-technical people and may even 
be carried out remotely or autonomously (e.g., by measurement devices 

1 0 used by a number of technicians walking through the physical 

environment, each being outfitted with a measurement device which 
randomnly makes measurements and where these measurements are all 

shared; this being more adequately described in U.S. Serial No. 09/ , 

filed July 28, 2000 entitled "System, Method and Apparatus for Portable 

15 Design, Deployment, Test and Optimization of a Communication 

Network, which is herein incorporated by reference). 

The invention supports the rapid visualization and display for 
comparing performance data gathered from a multitude of sources. The 
comparisons may be between two or more different sets of measurements 

20 made within the same 3-D environment of interest as described above. 
However, the comparisons may also be between two or more sets of 
network system performance prediction results that may be computed, 
displayed, or stored for latter display. The present invention creates a new 
method and system for providing a way to rapidly visualize the differences 

25 between different network system performance prediction results collected 

within the same 3-D environment, using similar or different 
communication network designs within the common environmental model. 

In addition to the above considerations, the present invention 
provides a means of displaying the differences between measured data and 

30 predicted data in a convenient manner which yields great insight into 
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actual versus predicted performance of any communications network. 
Based on the above teaching, it should be clear that measured data and 
predicted data may be displayed in a 3-D environment, and may be 
overlaid upon each other in space, in order to provide a registration of 
5 measured and predicted values. In this manner, it is possible to compare 

measurement runs to prediction runs, so long as the measurements are 
collected at points which are specified as desired locations for outputs of 
the prediction engine. One of ordinary skill in the art would be trained in 
data processing and error analysis and would be able to understand how 

10 novel visualization techniques that apply to: a) measured data, b) the 
comparison of measured data, and c) the comparison of predicted data 
could also be applied to the comparison of measured to predicted data. 
Using the novel visualization methods which are described subsequently to 
compare measured versus predicted values offers tremendous power for 

1 5 engineers who seek to develop and optimize and use prediction models 
that perform most accurately in particular physical environments. 

Comparisons of data points between prediction runs, measurement 
runs, or comparisons between prediction and measurement runs may be 
made in several ways. Data sets can be compared on a simple difference 

20 basis, where the numerical value of the data point in the first run (located 

at a specific location in the environmental database) is subtracted from the 
data point at the same corresponding location from the second run. Of 
course, the subtraction order may be reversed if preferred. Other ways of 
comparing data include computing a decibel (dB) difference, which 

25 corresponds to a logarithmic ratio of the two numerical values at the same 

location point. Alternatively, a relative value, which considers the largest 
or best value having a maximum value (say 100 or 1), and the smaller 
value is displayed as having a value less than the maximum. The level 
below the maximum value may be computed and displayed as the 

30 normalized value, or as a percentage, as compared to the maximum. 
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One difficulty in comparing measured data with predicted data, or 
comparing measurements or predictions that have been performed with 
different grid scales or data base resolutions is that the same corresponding 
location between the two data sets may not be tractable, for example, due 
to inexactness of registering position information of the field 
measurements with the modeled environmental location in the predictions. 
In this case, a nearest neighbor approach for point selection, or a random 
selection technique from a cluster of nearest neighbor points, may be made 
in order to determine the suitable point in each run to compare between. 
Or, an averaging method may be used, whereby local points in each of the 
data sets to be compared are averaged within a very small local area, and 
the resulting numerical values from each set are compared at a physical 
location point which is common to the small region occupied by the points 
used for averaging in each data set. This is known as "local averaging", 
and statistics may be deduced from the mean and variation of the local 
average of data in a particular run. These statistics may be compared and 
differences displayed between the statistics of each of the two runs under 
comparison. There are numerous other comparison methods that may be 
used to compare numerical values from two sets, and such comparison 
methods are considered, whether or not known now or in the future. 

Some data sets may be sparse compared to others which are offered 
up for comparison. In this case, a display mechanism is needed to 
illustrate that a comparison at a particular 3-D location point may not be 
made because of missing data from one or both of the sets. 

The preferred embodiment of the invention allows for the 
visualization of such comparisons using a variety of methods. Building on 
the concepts disclosed in co-pending application 09/318,840, entitled 
"Method and System for Automated Optimization of Antenna Positioning 
in 3-D", the present invention allows for one or more locations in space to 
serve as "watch points" where comparisons are stored as part of a 3-D 
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computer database and visualized on a display screen. The display of said 
watch points may be in a 2-D manner utilizing colors, shape, and/or text to 
indicate comparison data, or in a 3-D manner using height, color, shape, 
and/or text to indicate comparison data. 
5 In addition to visualization at one or more watch points, the present 

invention allows for a mesh of vertices indicating comparison data to be 
overlaid on top a selected region of any size or shape. 

The computer displays on the screen at each vertex of the mesh the 
comparison data indicating variations in RF performance values, for 

10 instance, received signal strength intensity (RSSI), network throughput, 
packet latency, packet error rate, quality of service (QoS), bit error rate, 
frame error rate, signal-to-interference ratio (SIR), and signal-to-noise ratio 
(SNR), provided by the communication systems just designed. The display 
is such that the computer adjusts the elevation and/or coloring including 

15 characteristics such as saturation, hue, brightness, line type and width, 

transparency, surface texture, etc., of each vertex relative to the 
surrounding vertices to correspond to the calculated comparisons of RF 
performance values. The coloring and elevation may correspond to the 
same calculated comparison value or to different variations in calculated 

20 comparison values. For example, elevation may correspond to comparisons 
between received signal strength intensity (RSSI), and color may 
correspond to comparisons between signal-to-noise ratio (SNR), or any 
other of a variety of comparisons between calculated RF parameters. The 
user is able to specify boundaries for this display in terms of selecting the 

25 range of elevations, colors, or other aesthetic characteristics from which 

the vertices of the mesh are assigned. Alternatively, the system can 
automatically select limits and ranges for the heights, colors, and other 
aesthetic characteristics. The result is a region of fluctuating color and 
elevation representing the changing comparisons between wireless system 

30 performance throughout different portions of the modeled 3-D 
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environment. The region may be viewed as an overlay within the 3-D 
environment. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other objects, aspects and advantages will be 
better understood from the following detailed description of a preferred 
embodiment of the invention with reference to the drawings, in which: 

Figure 1 shows an example of a simplified layout of a floor plan of 
a building; 

Figure 2 shows a three-dimensional perspective of a building floor 

plan; 

Figure 3 shows a three-dimensional perspective of a comparison of 
a set of performance values; 

Figure 4 shows an example region segmented into a grid that has 
been selected by a RF designer for displaying wireless system 
performance; 

Figure 5 shows a region similar to that shown in Figure 4 prior to 
the comparison of wireless system performance and from a three- 
dimensional perspective; 

Figure 6 shows a region following the comparison calculation of 
wireless system performance and is exemplary of the three-dimensional 
display of system performance from the present invention; 

Figure 7 shows the same region as in Figure 6 following the user 
reducing relative elevations of the vertices and thus altering the display; 

Figure 8 shows the same region as in Figure 7 following the user 
shading the display to produce an altered perspective of the performance 
results; and 

Figure 9 shows the same region as in Figure 6 following the user 
changing the view orientation to provide a different perspective of the 
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performance results; 

Figure 1 0 shows a flow diagram describing a process for comparing 
performance prediction results; 

Figure 1 1 shows a flow diagram describing a process for comparing 
performance predictions with measurement results; 

Figure 12 shows a flow diagram describing a process for comparing 
multiple measurement performance runs; 

Figure 13 shows a 3-D display of iconic representations for 
predicted performance data overlaying a 3-D physical environment; and 

Figure 14 shows a 3-D display of iconic representations for 
measurement data overlaying a 3-D physical environment. 

DETAILED DESCRIPTION OF A PREFERRED 
EMBODIMENT OF THE INVENTION 

Using the present method, it is now possible to assess the 
1 5 performance of a communication system to a much higher level of 

precision than previously possible. The present method is a significant 
advance over the prior art in the display of predicted performance of 
communication systems. The design of communication systems is often a 
very complex and arduous task, with a considerable amount of effort 
20 required to simply analyze the results of system performance. 

In the prior art, only a single performance prediction result could be 
analyzed at once. That is, having designed a communications system, 
there was no direct way to quickly visualize and compare advantages 
between having a hardware component in one communications network 
25 layout or another. In the present invention, a system is described where 

two or more predictions may be compared to analyze advantages or 
disadvantages between designs, models, or other factors. 

The present invention also allows for a measurement campaign to 
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be compared with predicted performance data for analysis purposes. In the 
prior art, there are some implementations available for comparing 
measured and predicted data sets. Most, however, are not visual 
comparisons; moreover, those packages available for displaying visual 
5 comparisons between measurements and predictions are 2-D only. That is, 

until this invention there is no way to fully visualize such comparisons for 
a communication network in a 3-D manner. 

The present invention describes several methods for visualization 
of comparisons between communication system performance values which 

10 are either predicted or measured. In all cases, the visualization described 
could be applied to measurements, predictions, comparisons between 
prediction models, comparisons between predictions of different 
communication systems, comparisons between predicted and measured 
data, comparisons between different measurement data sets, or 

1 5 comparisons between other data known now or in the future. 

Referring now to Figure 1, there is shown a two-dimensional (2-D) 
simplified example of a layout of a building floor plan. The method uses 3- 
D computer aided design (CAD) renditions of a building, or a collection of 
buildings and/or surrounding terrain and foliage. However, for simplicity 

20 of illustration a 2-D figure is used. The various physical objects within the 
environment such as external walls, internal walls and floors are assigned 
appropriate physical, electrical, and aesthetic values. For example, outside 
walls may be given a lOdB attenuation loss, signals passing through 
interior walls may be assigned 3 dB attenuation loss, and windows may 

25 show a 2 dB RF penetration loss. In addition to attenuation, the 

obstructions are assigned other properties including reflectivity and surface 
roughness. 

Figure 2 depicts the three-dimensional perspective of a building 
floor plan. Referring to Figure 2, there are several partitions within the 
30 building structure, including exterior concrete walls and interior sheetrock 
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walls. 

Estimated partition electrical properties loss values can be extracted 
from extensive propogation measurements already published, which are 
deduced from field experience, or the partition losses of a particular object 
5 can be measured directly and optimized instantly using the present 
invention combined with those methods described in the copending 
application Serial No. 09/221,985, entitled "System for Creating a 
Computer Model and Measurement Database of a Wireless 
Communication Network" filed by T. S. Rappaport and R. R. Skidmore. 

10 Once the appropriate physical and electrical parameters are specified, any 
desired number of hardware components of RF sources can be placed in 
the 3-D building database, and predicted RF performance values such as 
received signal strengths (RSSI), network throughput, packet latency, 
packet error rate, quality of service (QoS), bit or frame error rate, chip 

15 energy to interference ratio (Ec/Io), or carrier-to-interference (C/I) ratios 

can be obtained. Of course, other well known communication parameters 
for wired or wireless communications systems, known now or in the 
future, may be used for appropriate prediction values. The preferred 
method for generating a 3-D environmental database is disclosed in the co- 

20 pending application Serial No. 09/3 1 8,84 1 , filed on May 26, 1 999. The 

resulting definition utilizes a specially formatted vector database 
comprising lines and polygons that represent physical objects within the 
environment. The arrangement of lines and polygons in the database 
corresponds to physical objects in the environment. For example, a line or 

25 other shape in the database could represent a wall, a door, a tree, a building 

wall, or some other physical object in the modeled environment. 

From the standpoint of radio wave propagation, each 
obstruction/partition in an environment (i.e., each line or polygon in the 
drawing) has electromagnetic properties that affect a radio wave. When a 

30 radio wave signal intersects a physical surface, it interacts with the 
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electromagnetic properties of the surface. A certain percentage of the radio 
wave reflects off of the surface and continues along an altered trajectory; a 
certain percentage of the radio wave penetrates through the surface and 
continues along its course; a certain percentage of the radio wave is 
scattered once it strikes the surface, etc. The electromagnetic properties 
given to the obstruction/partition defines this interaction, and thus defines 
the break down in percentages of the radio wave reacting in a given 
manner upon intersection. In terms of the environmental database, each 
obstruction/partition has several parameters used to define its 
electromagnetic properties. For example, the attenuation factor of a 
partition determines the amount of power lost by a radio signal that 
penetrates through it; the reflectivity of a partition determines the portion 
of the radio signal reflected from it; and the surface roughness of a 
partition determines the portion of the radio signal that is scattered upon 
intersection. 

Once the 3-D environmental database has been constructed, the 
designer identifies and specifies the location and type of all wireless 
communication system equipment within the 3-D environmental. This 
point-and-click process involves the user selecting the desired hardware 
component from a computer parts database and then visually positioning, 
orienting, and interconnecting various hardware components within the 3- 
D environmental database to form complete wireless communication 
systems. The preferred embodiment of the computer parts database, 
referred to hereinafter as a parts list library, is more fully described in co- 
pending application Serial No. 09/318,842, filed on May 26, 1999. The 
resulting interconnected network of base station transceivers, cabling, 
connectors/splitters, amplifiers, antennas, and other RF hardware 
components (commonly known as a wireless distribution or antenna 
system) is preferably assembled using either a drag-and-drop or a pick-and- 
place technique and is graphically displayed overlaid with the 3-D 
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environmental database. Each component utilizes electromechanical 
information available from the parts list library that fully describes the 
component in terms of its physical operating characteristics (e.g., the noise 
figure, frequency, radiation characteristics, etc.). This information is 
5 directly utilized during the prediction of wireless system performance 

metrics. 

Having a complete 3-D environmental model and a wireless 
communications system placed within the environment, the designer may 
acquire performance data by running prediction models on the 

10 communications system, collecting RF measurement data from the actual 
site the environmental model represents, or by some other method known 
now or in the future. 

In the present invention, the designer may run performance 
prediction calculations, measure actual performance characteristics within 

1 5 an environment, or gather performance data using some other method 
known now or in the future. The novelty of the current method and 
apparatus is for displaying the results of measurements, performance 
prediction results, comparisons of measurements to performance prediction 
results, comparisons of two or more predicted performance results, and 

20 comparisons of two or more measurements. The 3-D visualization method 
allows an engineer or technician to rapidly determine the meaning or 
importance of the displayed information. 

To visualize performance or performance comparisons, several 
methods are employed in the present invention. When two sets of 

25 performance data are available, a direct visualization may be made. That 

is, statistics such as a difference or absolute difference, a percentage, a 
ratio such as decibels (dB), or some other statistics known now or in the 
future may be employed. Given two sets of performance data of equal 
size, the desired statistical calculations are performed on each element in 

30 the sets. In the event one of the data sets is larger than the other or the two 
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data sets do not contain the same spatial elements, comparison calculations 
are performed on each element residing at the same spatial location in both 
data sets. Where there is misalignment between the two sets, an averaging, 
nearest neighbor, or random method could also be used to obtain 
5 registration in space. 

The resulting comparison calculations may be visualized directly 
on the 3-D environment database. Using variations in object shape, color, 
and/or height, the calculations may be visualized as shapes such as 
cylinders^ rectangular prisms, spheres, cubes, or other objects directly in 

10 the 3-D environment database to show performance comparisons. Figure 3 
depicts a comparison of performance values where cylinders of varying 
height and color are shown in 3-D to indicate differences between 
predicted and measured data. 

Where sufficiently many data points are available, a grid of many 

15 vertices indicating varying height and/or color may be overlaid on the 3-D 

environmental database to indicate spatial fluctuations in performance 
comparisons. Figure 4 shows an environmental database that has been 
segmented into a grid of vertices. Each vertex will correspond to a 
comparison data location. Figure 5 shows the same environmental 

20 database and overlaid grid from a 3-D perspective. 

Once the performance comparison is complete, the designer is free 
to configure the display of the results. The displayed results may be 
presented on a display screen, printed or otherwise 3-D rendered. The 
range of values to display and the color and other aesthetic characteristics 

25 such as saturation, hue, brightness, line type and width, transparency, 

surface texture, etc., to associate with each value are selectable, or may be 
automatically adjusted by the system. For example, if displaying 
comparisons between received signal strength intensities (RSSI), the user 
may select to only display those portions of the region having a relative 

30 RSSI difference within the range -20 dBm to 20 dBm, and may assign 
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specific colors to correspond to compared RSSI values within that range. 
For example, the user may assign the color red to represent a relative RSSI 
difference between -20 dBm and -10 dBm, green to represent a relative 
RSSI difference between -9 dBm and 0 dBm, etc. Thus, the region is 
displayed as a pattern of fluctuating colors where the color assigned to 
each vertex within the grid corresponds to a certain value for the compared 
performance metric. Figure 6 depicts a 3-D comparison graphically, using 
variations in height and color to indicate differences between 
communication system performance. 

In similar fashion, each vertex of the grid or other point in space 
representing a performance comparison data point is repositioned vertically 
in 3-D space. The elevation of each comparison data point directly 
corresponds to a certain value of compared performance. In the preferred 
embodiment of the invention, the user specifies the maximum and 
minimum elevation to assign to vertices, and the computer automatically 
scales the elevation of each comparison data point according to its 
compared performance value. For example, if the user selects a minimum 
height of 0.0 meters and a maximum height of 20.0 meters, and the 
compared performance values for the entire grid range from -20 dBm to 20 
dBm for an RSSI difference comparison, if a given comparison data point 
has a value of 0 dBm it will be assigned an elevation of 10.0 meters. All 
elevations are specified relative to the 3-D environmental database. Figure 
7 depicts a 3-D comparison that has been repositioned for better viewing 
and analysis. 

Any combination of elevation, color, and other aesthetic 
characteristics may be used to customize the display of compared 
performance results. For example, signal-to-interference ratio (SIR) 
differences may be displayed as fluctuating elevation within the region 
while received signal strength (RSSI) differences are displayed by 
fluctuating colors. Data throughput percentages may be displayed as 
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varying colors while bit error rate (BER) differences are displayed using 
differing line types. Any combination of elevation, color, and other 
aesthetic characteristics may be associated with any combination of 
compared performance result metric to produce the 3-D display. 
5 The results of the performance comparison are overlaid with or 

superimposed on the 3-D environmental database, allowing the user to 
analyze the performance of the current wireless communication system 
design. The display can be further customized through user interaction. 
The designer may reorient the viewing direction and zoom factor of the 

10 display to achieve varying perspectives of the comparison results. The 

results may be redisplayed in a variety of forms, including 3-D wireframe 
with hidden lines removed, 3-D semi-transparent, 3-D shaded or patterned, 
3-D rendered, or 3-D photo-realistically rendered. The designer is free to 
interact with the displayed results in a variety of ways, including real-time 

15 panning and zooming to create a "fly-through" effect. Figure 8 depicts a 

comparison of system performance where the 3-D display has been 
appropriately shaded for viewing and analysis purposes. Similarly, Figure 
9 shows the same comparison from a different viewpoint. The compared 
performance results may be saved for later recovery and redisplay. 

20 In the event that more than two data sets are available for 

comparison, a sequential animation showing the graphical 3-D 
comparisons between any two sets can be shown. The designer is able to 
control which two sets are compared at any time, and can easily flip 
through a large number of comparisons. 

25 The present invention creates a new method and system for 

providing a way to conveniently visualize individual measurement points 
for rapid inference of meaning, as well as conveniently visualizing and 
rapidly inferring the meaning of differences between measurement runs 
collected within the same 3-D environment, using the same or different 

30 communication network designs. A measurement run is a series of 
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measurements, usually performed by a technician or engineer within an 
environment (such as a city, a town, a campus, a group of buildings, or a 
building of interest), although such measurements may be carried out by 
non-technical people and may even be carried out remotely or 
5 autonomously (e.g., by measurement devices used by a number of 
technicians walking through the physical environment, each being 
outfitted with a measurement device which randomnly makes 
measurements and where these measurements are all shared; this being 
more adequately described in U.S. Serial No. 09/ , filed July 28, 

10 2000 entitled "System, Method and Apparatus for Portable Design, 

Deployment, Test and Optimization of a Communication Network, which 
is herein incorporated by reference). 

We consider measurements to have a position location tagged with 
each measurement, using either automatic or manual means as taught in 

1 5 the co-pending application Serial Nos. 09/221 ,985, filed December 29, 

1998. As described subsequently, the present invention performs 
comparisons and provides novel displays for different measurement runs, 
which may be a collection of measured points that are collected from a 
single communication network at different times of day, on perhaps 

20 different days, using the same or different frequencies, using the same or 

different operational modes (where different operational modes may 
include, but not be limited to, one or more of the following: different data 
transmission rates, different packet sizes, different modulation techniques, 
different power levels, different psuedonoise code sequencing, different 

25 psuedonoise code chip timing, different optical frequency bands, different 

network protocols, different bandwidths, different multiple-access 
techniques, different antenna distribution systems, different antenna 
systems, different wiring architectures, different cabling methods or system 
distribution methods, different physical interconnections of system 

30 components to comprise the communication system, or different source or 
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error correction coding methods), or under different traffic loading 
conditions (due to bandwidth variations, user density, or some other means 
that causes traffic flow or capacity to change over time). Alternatively, 
measurement runs may be made in a particular environment where two or 
5 more different communication systems are installed to provide network 

connectivity within the environment. This is common when one attempts 
to measure two or more competitive wireless service providers within a 
city or campus environment, or when one wishes to compare the 
performance of two or more different network architectures within a 

1 0 particular environment. 

As an example, a measurement run for a wireless inbuilding system 
might involve a technician using a mobile receiver who would canvass 
each floor of the building to measure the received signal from the installed 
inbuilding wireless office system. The technician might use the 

1 5 InFielder™ 3-D measurement system connected to a WaveSpy™ scanning 

receiver to measure, say, RSSI values, within the 3-D environment of 
interest, whereby a model of the 3-D environment resides within InFielder. 
The same or a different technician might then measure again the same 
building, either simultaneously, at a later date, or under different 

20 operational conditions. As shown subsequently, the present invention 

provides a novel way to display the difference of two or more 
measurement runs for comparison, and to display such differences so that 
rapid comparisons may be made by visualizing the resulting differences 
within the model of the 3-D environment. 

25 While the above example is for an in-building wireless system, it 

will be clear to one trained in the art of design, installation, and 
maintenance of any communication network that similar methods may be 
applied to the comparison and display of measurement runs for any type 
of communication network, and where such measurement runs could be 

30 made for a single network in a particular environment, or for two or 
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more differently configured communication networks within the same 
physical environment, and that this approach may apply to optical 
networks, baseband networks, and a collection of wireless and wired 
networked devices which might share a common or different wired or 
5 wireless backbone(s). For an optical network within a building, for 

example, a measurement run would consist of making measurements at 
each wall terminal or cable junction box within the building. Rather than 
roam around, the measurement run for a fixed network would consist of 
taking samples at fixed locations. The present invention provides for 

10 display of such measurements within a 3-D environment as well as a 

convenient display for comparing two or more such measurement runs. 
Furthermore, measurement runs may include the collection of measured 
values or sample values, collected over time and space, of any or all of 
the various network system performance values taught earlier, and these 

15 measurements could be conducted within the environment simultaneously 
by two or more measurers or measurement devices, or conducted at 
different times by one or more measurers or measurement devices. 
Alternatively, one can contemplate measurement methods that allow 
multiple sensors/receivers or multiple transmitters to simultaneously 

20 record measurement data, and such data and comparisons between data 
may be displayed using methods taught subsequently in this invention. 

A network system performance prediction result is a numerical 
value or a string of numerical values produced by a communication 
system modeler or simulator that serves as an estimate for a measured 

25 numerical value or string of numerical values that would be produced 

(e.g. measured or seen) by an actual communication system operating in 
the specified configuration and environment used for the performance 
prediction. The numerical values or string of numerical values represent 
certain communication parameters, quality metrics, or physical 

30 representations of the operating environment that can generally be 
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measured by a network system communication device or a system of 
devices which can be used to predict the suitability or performance of a 
particular communication device within the environment. Appropriate 
and commonly used measurements and parameters and physical 
5 representations are taught earlier, and are well known to those skilled in 
the art of communication system design, network design, and 
measurement of communication systems. Network system performance 
prediction results are created by one or more analytical calculations, 
empirically applied models, or simulation outputs that are computed 

10 within a prediction engine, which may or may not use measurements at 
the time of computation. The network system performance prediction 
results allow engineers or technicians to properly install or design 
communication devices, and attempt to include the effects of the 
operating environment so they can be used by a network system designer 

1 5 to make sensible judgments and predictions about how well a proposed 

system might perform. The complexities of a multiple-user local or wide 
area network are extreme, and it is not possible to model all of the 
variables which cause a particular network to perform a particular way at 
a particular time and spatial location. However, researchers have 

20 developed key findings that help isolate the most important factors that 
dictate network performance, and these most important factors are 
generally used in the computations that yield network system 
performance prediction results. For example, as shown in Rappaport 
(T.S. Rappaport, Wireless Communications, Principles and Practice, 

25 Prentice Hall, 1996, NJ), in a wireless communication system, if the 
physical distance between a transmitter and receiver is known, and the 
physical environment is known and modeled for various partition losses, 
it is possible to create an analytical site-specific communications model 
that yields the unequalized bit error rate for a wireless device that uses 

30 BPSK modulation. From this model, it becomes possible to carry out 

32 


256036AA 

network designs, based on bit error rate, in a 3-D environment. Similar 
models, of the analytical, empirical, and simulation-based kind, exist for 
optical, wireless, and baseband networks. 

Network system performance prediction results may be computed 
5 within any environment (such as a city, a town, a campus, a group of 

buildings, or a building of interest). As described subsequently, the 
present invention performs comparisons and provides novel displays for 
comparing the results of different network system performance prediction 
results, whereby each collection of network system performance prediction 

10 results performed throughout a part of the modeled environment is called a 

prediction run, where a prediction run is a collection of one or more 
predicted values at points or grids or volumes over space that are produced 
from one or more modeled communication network(s) simulated in the 
prediction engine, but which may be simulated multiple times to produce 

1 5 different resulting prediction runs that may be compared , using the same 

or different frequencies, using the same or different operational modes 
(where different operational modes may include, but not be limited to, one 
or more of the following: different data transmission rates, different 
packet sizes, different modulation techniques, different power levels, 

20 different pseudo-noise code sequencing, different pseudo-noise code chip 

timing, different optical frequency bands, different network protocols, 
different bandwidths, different multiple-access techniques, different 
antenna distribution systems, different antenna systems, different wiring 
architectures, different cabling methods or system distribution methods, 

25 different physical interconnections of system components to comprise the 
communication system, or different source or error correction coding 
methods), or under different traffic loading conditions (due to bandwidth 
variations, user density, or some other means that causes traffic flow or 
capacity to change over time). Alternatively, network system performance 

30 prediction results may be computed in a particular environment where two 
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or more different communication systems are modeled to provide network 
connectivity within the environment. This is common when one attempts 
to understand or predict how alternative communication network 
architectures within a particular environment might perform. 
5 As an example, network system performance results might be 

computed to create a prediction run for predicted signal-to-noise ratio 
(SNR) for a wireless inbuilding system throughout a building. If the 
models used in the prediction engine were sufficiently accurate, then such 
a process would eliminate the need for measurement runs in order to 

10 install a properly functioning system. In the prediction engine 

contemplated by SitePlanner ®, which is disclosed in part in all of the 
cross referenced co-pending applications listed above, various 
performance parameters which provide electrical, mechanical, numerical, 
or physical descriptions of the modeled communication system must be 

15 provided. These performance parameters may include the addition, 
removal, replacement, re-connection, re-orientation, or some other 
modification of one or more attributes which describe one or more of the 
effects that are required for accurate simulation performance of the 
prediction engine. Some examples of such inputs might include: physical 

20 locations of transmitters, antennas, RF distribution lines, connectors, 

splitters, base station controllers, switches, optical-to-RF couplers; cable 
losses, splitter losses; antenna patterns; power levels of the transmitters; 
gains of the amplifiers, and frequencies to be simulated, must be applied 
to the input of the prediction engine. While the list in the preceding 

25 sentence is not meant to be exhaustive, it demonstrates the level of detail 
and interconnectivity dependencies that are considered to properly model 
the transmission system, both physically and electrically, as it would 
actually be installed in a real building. This is because of the 
visualization capabilities of the invention which focuses on illustrating the 

30 network as it really appears in true life. Other inputs required by the 
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prediction engine include a 2-D or 3-D computerized model of the actual 
operating environment, with specified floor locations, ceiling heights, 
and other 3-D information, or maps which are either 2-D or 3-D. To 
compute, store, and display the network system performance results in 
5 the 3-D environmental model, particular points, grids, or zones must be 
specified or requested by the user in order to determine the exact 3-D 
location of where the network system performance results (in this case, 
SNR) will be computed and displayed. Upon completion of a sequence 
of simulations throughout the environment, a prediction run will be 

10 created and displayed. 

Prediction runs produced by the prediction engine may consider 
alternate models, communication network architectures, or different 
operating modes within the same physical environment, as well as other 
obvious perturbations that would be appropriate and interesting to a 

1 5 wireless network designer, either now or in the future. As shown 

subsequently, the present invention provides a novel way to display the 
difference of two or more prediction runs for comparison, and to display 
such differences so that rapid comparisons may be made by visualizing the 
resulting differences within the model of the 3-D environment. 

20 While the above example is for an in-building wireless system, it 

will be clear to one trained in the art of design, simulation or analysis of 
any communication network that similar methods may be applied to the 
comparison and display of prediction performance results and prediction 
runs for any type of communication network, and where such predictions 

25 could be made for a single network modeled in a particular environment, 
or for two or more differently configured communication networks 
modeled within the same physical environment, and that this approach may 
apply to networks and systems modeled as optical networks, baseband 
networks, and a collection of wireless and wired networked devices which 

30 might share a common or different wired or wireless backbone(s). For 
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predictions of a wired optical network within a building, for example, 
simulations designed to produce network system prediction results would 
consist of providing the proper inputs and environmental model to the 
prediction engine, and then specifying output values be provided in the 
5 modeled environment at the exact location of each wall terminal, port, or 

cable junction box within the modeled building. The present invention 
provides for display of differences between two or more prediction runs 
within a 3-D environment as well as a convenient display for comparing 
two or more such prediction runs. Furthermore, prediction runs may 

10 include collections of predicted values, collected over time and space, for 

any or all of the various network system performance values taught earlier, 
and these predicted values could be acquired within the model of the 
environment simultaneously by executing the prediction engine on two or 
more computers, which may be connected as parallel processing machines, 

1 5 or independent computing devices, or which may be predicted at different 

times by one or more computers each running one or more prediction 
engines. Alternatively, we contemplate prediction methods that allow 
multiple locations in the environmental model to be computed for and 
displayed simultaneously, and such predicted data and comparisons 

20 between data may be displayed using methods taught subsequently in this 
invention. 

In addition to the above considerations, the present invention 
provides a means of displaying the differences between measured data and 
predicted data in a convenient manner which yields great insight into 

25 actual versus predicted performance of any communications network. 

Based on the above teaching, it should be clear that measured data and 
predicted data may be displayed in a 3-D environment, and may be 
overlaid upon each other in space, in order to provide a registration of 
measured and predicted values. In this manner, it is possible to compare 

30 measurement runs to prediction runs, so long as the measurements are 


36 


6 


256036AA 

collected at points which are contained in the same environment which is 
modeled by the prediction engine. Measurement points may be at the same 
locations as prediction points or comparisons may be made between 
measurement points which are close to prediction points as specified 
5 above. Also, simply plotting measurement and predicted points which are 

not co-located still allows easy 3D visualization of differences, for rapid 
comparisons. It is clear to one trained in data processing and error analysis 
how novel visualization techniques that apply to: a) measured data, b) the 
comparison of measured data, c) predicted data, and d) the comparison of 

1 0 predicted data could also be applied to the comparison of measured to 
predicted data. Using the novel visualization methods which are 
described subsequently to compare measured versus predicted values 
offers tremendous power for engineers who seek to develop and optimize 
and use prediction models that perform most accurately in particular 

1 5 physical environments . 

Now consider a practical user of a wireless design system. If the 
designer wishes to use predicted performance data for the basis of 
comparisons, he or she selects the wireless communication system 
performance predictive model to utilize. The preferred embodiment uses a 

20 number of methods to predict and optimize performance in a wireless 

communication network. These include methods to incorporate and build 
upon performance prediction techniques such as those described in the 
previously cited and following technical reports and papers: "Interactive 
Coverage Region and System Design Simulation for Wireless 

25 Communication Systems in Multi-floored Indoor Environments: SMT 

Plus," IEEE ICUPC '96 Proceedings, by R. Skidmore, T. Rappaport, and 
A.L. Abbott, and "SitePlanner 3.16 for Windows 95/98/NT User's 
Manual", Wireless Valley Communications, Inc. 1999, all of which are 
hereby incorporated by reference. It would be apparent to one skilled in 
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the art how to apply other wireless communication system performance 
models to this method. 

When making comparisons using prediction data, several methods 
may be employed to visualize the results. As described in co-pending 
5 application 09/352,678, entitled "System for the Three-Dimensional 

Display of Wireless Communications System Performance", the present 
method may employ a grid of vertices placed over a region of any shape or 
size to cover the predicted area. At each vertex in the grid, the 
communications network performance is predicted, and the set of all 
10 performance predictions may be stored, logged, or displayed as described 
O in patent application 09/352,678. 

m Other methods for generating a set of prediction comparison data 

?; may also be employed. As described in co-pending application 

83 09/3 1 8,840, entitled "Method and System for Automated Optimization of 

Gj 1 5 Antenna Positioning in 3-D", the present invention can make use of one or 

JL more locations in the 3-D environment, termed "watch points", for making 

00 predictions. Using the aforementioned prediction models, the performance 

£ values at each watch point are calculated and then stored, logged, or 

S displayed as described in patent application 09/3 1 8,840. 

20 Other methods could be employed for generating prediction 

comparison data sets. It should be obvious to one of skill in the art that the 
novelty of the present invention will remain regardless of how the 
prediction data set is generated. The aforementioned methods for 
generating a data set are simply given as examples from the current 
25 embodiment. 

Referring now to Figure 10, there is shown a flow diagram 
according to the present invention for comparing prediction data. Having 
an environmental model 100 available for making predictions, a system of 
RF hardware devices 1 1 0 is positioned in the environmental model. An 
30 initial set of prediction data 120 is made using a selected prediction model. 
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The communications system may be redesigned in block 130 by adding, 
removing, or replacing hardware RF components, or by changing the 
layout, orientation, or other electrical or mechanical parameters of the 
existing hardware RF components. A second prediction data set 140 is 
5 then obtained for the purposes of comparison with the initial prediction 

data. Because each prediction data set is stored on a computer, any two or 
more predictions may be compared with another in block 150 and those 
comparisons stored in block 160. The designer is free to recursively alter 
the communications system as necessary and compare how the changes 

1 0 impact predicted performance. 

It should be obvious to one of skill in the art that, rather than 
comparing two communication systems separately, a comparison could be 
made between two or more communication systems existing at a single 
time in a physical environment. Existing prior art such as SitePlanner® 

1 5 from Wireless Valley Communications, Inc. are already capable of 

performing such calculations, and hence are not covered by the present 
invention. One of the novelties of the present invention is in comparing 
changes made to a communication systems and visualizing the changes in 
the form of a direct comparison. 

20 None of the existing prior art is capable of displaying comparisons 

between measured and predicted data on top of a 3-D environmental 
model. Using the present invention, measurement data collected may be 
used as a performance data set for comparison. As described in co- 
pending application 09/221,985, entitled "System for Creating a Computer 

25 Model and Measurement Database of a Wireless Communication 

Network", measurement data may be collected from a variety of radio 
receivers attached to a computer running SitePlanner®. 

Referring now to Figure 1 1 , a flow diagram is shown for comparing 
measured data with predicted data. Having an environmental model 200 

30 available for making predictions, a system of RF hardware devices 210 is 
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positioned in the environmental model. A set of prediction data 220 is 
made using a selected prediction model. The designed communication 
system is built into the real-world physical environment in function block 
230, and measurement data is collected in 240 using an attached radio 
5 receiver. With available measurement data; a comparison is made between 

the predicted performance data set and the measurement data set in 
function block 250. The comparison data is displayed and/or stored as 
previously discussed in block 260. 

Figure 12 shows a flow diagram for comparing multiple 

10 measurement data sets with each other. Having an environmental model 

300 available for making predictions, a system of RF hardware devices 310 
is positioned in the environmental model. The designed communication 
system is built into the real-world physical environment in function block 
320, and measurement data is collected in 330 using an attached radio 

1 5 receiver. The entire design, build-out, and measurement collection 

procedure may be repeated many times, and measurement data sets may be 
compared and stored and displayed repeatedly in blocks 340 and 350. 

Referring now to Figure 13, the display of predicted performance 
metrics at each watch point can take the form of shaded colored cylindrical 

20 markers overlaid with the 3-D environmental model. In this form of 

presentation, both the height and color of the cylindrical graphical entities 
corresponds to the predicted performance metrics at that location in the 3- 
D environmental model. The designer has full control of both the range of 
colors and the range of heights that the cylindrical graphical entities can 

25 adopt. This form of presentation enables the designer to rapidly assess the 
performance of the wireless communication system by providing a much 
more dramatic display of the predicted results. In Figure 13, as the 
designer moves the mouse or other computer pointing device cursor, an 
antenna component 601 is effectively relocated and/or reoriented within 

30 the 3-D environmental model. In real-time, the new predicted performance 
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metrics given the new position and/or orientation of the antenna 
component are represented at each of the watch points 602 as three- 
dimensional shaded colored cylinders. One skilled in the art could see how 
the watch point graphical entities could easily assume the form of three- 
dimensional cones, pyramids, cubes, or any other three-dimensional 
graphical entity as well with similar results. 

Referring now to Figure 1 4, the display of measured performance 
metrics at each watch point can take the form of shaded colored cylindrical 
markers overlaid with the 3-D environmental model. Similar to Figure 13, 
both the height and color of the cylindrical graphical entities corresponds 
to the measured performance metrics at that location in the 3-D 
environmental model. The designer has full control of both the range of 
colors and the range of heights that the cylindrical graphical entities can 
adopt. This form of presentation enables the designer to rapidly assess the 
performance of the wireless communication system by providing a much 
more dramatic display of the measured results. For example, with the 
present invention, differences between measurement runs and/or prediction 
runs can be easily visualized in the 3-D environment, even if some or all of 
the individual data points to be compared are not co-located or interpolated 
to approximate co-location. By having a 3-D visualization where height, 
width, color, shape, thickness are easily discernible between data sets, the 
user can quickly and visually compare results. Furthermore, the vertical 
display nature of the 3-D watchpoints or a collection of watchpoints that 
form a grid of watchpoints appear to rise above the displayed physical 
environment. One skilled in the art could see how the watch point 
graphical entities could easily assume the form of three-dimensional cones, 
pyramids, cubes, or any other three-dimensional graphical entity as well 
with similar results. 

While the invention has been described in terms of a single 
preferred embodiment, those skilled in the art will recognize that the 
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invention can be practiced with modification within the spirit and scope of 
the appended claims. For example, this invention may not be limited just to 
wireless communication systems, but may be used to present any type of 
electromagnetic characteristics superimposed on any simulated three- 
dimensional environment. For example, the invention would find 
application in the next generation field of micromachines and 
nanomachines or micro-electrical-mechanical machines (MEMS). These 
machines are extremely small yet highly sophisticated functional elements 
that allow them to perform complicated tasks in hard-to-access locations, 
such as inside the human body, in plumbing, in jet engines, etc. It will be 
necessary to both wirelessly communicate with these machines as well as 
wirelessly provide power for these machines, such as in the form of RF 
pulses, infrared (IR) light or any other form of electromagnetic medium. 
The present invention would therefore facilitate the modeling and 
presentation of this or any other wireless electromagnetic system. 
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